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(54) Title: MULTIPLE CACHE COMMUNICATION 



(57) Abstract 

The invention provides a method and system for op- 
erating multiple communicating caches. Between caches, 
unnecessary transmission of repeated information is sub- 
stantially reduced. Each cache maintains information to 
improve the collective operation of the system of multiple 
communicating caches. This can include information about 
the likely contents of each other cache, or about the be- 
havior of client devices or server devices coupled to other 
caches in the system. Pairs of communicating caches sub- 
stantially compress transmitted information. This includes 
both reliable compression, in which the receiving cache can 
reliably identify the compressed information in response to 
the message, and unreliable compression, in which the re- 
ceiving cache will sometimes be unable to identify the com- 
pressed information. A first cache refrains from unneces- 
sarily transmitting the same information to a second cache 
when each already has a copy. This includes both main- 
taining a record at a first cache of information likely to be 
stored at a second cache, and transmitting a relatively short 
identifier for that information in place of the information 
itself. A set of caches are disposed in a directed graph 
structure, with a set of root caches disposed for coupling to 
server devices and a set of leaf caches disposed for coupling 
to client devices. Both root caches and leaf caches main- 
tain non-cacheable objects beyond their initial use, along 
with digests of the non-cacheable objects. When a server 
device returns identical information to a root cache, root 
caches can transmit only associated digests to leaf caches, 
avoiding re-transmitting the entire non-cacheable object. 
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Title of the Invention 

MULTIPLE CACHE COMMUNICATION 

5 Background of the Invention 

/. Field of the Invention 

This invention relates to caches. 

10 

2. Related Art 

In a computer system in which client devices request information from one 
or more server devices, it is sometimes desirable to provide a cache; that is, a device that 
maintains copies of requested information so multiple requests for the same information 
can be satisfied at the cache. When requests for information are satisfied at the cache, 
the server devices need not receive the requests, process them, and retransmit the same 
information over a communication channel that links the client devices and the server 
devices. For example, the server devices can be web servers, the client devices can be 
web clients, the communication channel can be an IP network such as the Internet, and 
the requested information can be web ob jects. 

Some information requested from the server devices is considered not 
cacheable, for one or more of several reasons. As examples, the server can refuse to al- 
low the information to be cached, or the information can be a result of a dynamic process 
that can provide differing results for the same request (so caching would obviate the op- 
eration of that dynamic process). An example of dynamically processed information 
could include advertisements, database searches, or output from CGI scripts. 

However, it often occurs that non-cacheable information is requested a sec- 
ond time without having changed, so the second request to the server results in identical 
information being returned. In a system with multiple communicating caches, transmit- 
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ting the same information from a first cache to a second cache ^when each already has a 
copy) is an inefficient use of communication resources. 

Accordingly, it would be desirable to provide a method and system for op- 
erating a set of multiple communicating caches, in which transmission of repeated infor- 
mation is substantially reduced or eliminated. A first aspect of the invention is to main- 
tain information at each cache to improve the collective operation of multiple communi- 
cating caches. A second aspect of the invention is to substantially reduce the amount of 
information transmitted between multiple communicating caches. A third aspect of the 
invention is to refrain from unnecessarily transmitting the same data from a first cache to 
a second cache when the latter already has a copy. 

Summary of the Invention 

The invention provides a method and system for operating a set of multiple 
communicating caches. Between caches, unnecessary transmission of repeated informa- 
tion is substantially reduced. 

In a first aspect of the invention, each cache maintains information to im- 
20 prove the collective operation of the system of multiple communicating caches. This can 
include information about the likely contents of each other cache, or about the behavior 
of client devices or server devices couple d to other caches in the system. 

In a second aspect of the invention, pairs of communicating caches sub- 
25 stantially compress transmitted information. This includes both compression in which 
the receiving cache can reliably identify the compressed information in response to the 
message, and compression in which the receiving cache will sometimes be unable to 
identify the compressed information. 



15 



30 



In a third aspect of the invention, a first cache refrains from unnecessarily 
transmitting the same information to a second cache when each already has a copy. This 
includes both maintaining a record at a first cache of information likely to be stored at a 
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second cache, and transmitting a relatively short identifier for uiat information in place of 
the information itself. 

In a preferred embodiment, a set of caches are disposed in a directed graph 
5 structure, with a set of root caches disposed for coupling to server devices and a set of 
leaf caches disposed for coupling to client devices. Both root caches and leaf caches 
store non-cacheable objects beyond their initial use, along with relatively short identifiers 
for the non-cacheable objects. When a server device returns identical information to a 
root cache in response to a request for a non-cacheable object, that root cache transmits 
10 only the identifier of the non-cacheable object to the requesting leaf cache, avoiding re- 
transmitting the entire object if the leaf cache still has the object. 

Brief Description of the Drawings 

1 5 Figure 1 shows a block diagram of a system having multiple caches. 

Figure 2 shows a process flow diagram for a method of using a system 
having multiple caches. 

20 Detailed Description of the Preferred Embodiment 

In the following description, a preferred embodiment of the invention is 
described with regard to preferred process steps and data structures. Those skilled in the 
art would recognize after perusal of this application that embodiments of the invention 
25 can be implemented using one or more general purpose processors or special purpose 
processors or other circuits adapted to particular process steps and data structures de- 
scribed herein, and that implementation of the process steps and data structures described 
herein would not require undue experimentation or further invention. 

30 Inventions disclosed herein can be used in conjunction with inventions dis- 

closed in one or more of the following patent applications: 

3 
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o Provisional w.S. Application 60/048,986, filed June 9, 1997, in the name of in- 
ventors Michael Malcolm and Robert Zarnke, titled "Network Object Cache En- 
gine", assigned to CacheFlow, Inc., attorney docket number CASH-001 (P). 

5 o U.S. Application Serial No. 08/959,058, filed October 28, 1997, in the name of 
inventors Michael Malcolm and lan Telford, titled "Adaptive Active Cache Re- 
fresh", assigned to CacheFlow, Inc., attorney docket number CASH-003. 

o U.S. Application Serial No. 08/959,313, filed October 28, 1997, in the name of 
10 inventors Doug Crow, Bert Bonkowski, Harold Czegledi, and Tim Jenks, titled 

"Shared Cache Parsing and Pre fetch", assigned to CacheFlow, Inc., attorney 
docket number CASH-004. 



o U.S. Application Serial No. 09/093,533, filed June 8, 1998, in the name of inven- 
15 tors Michael Malcolm and Robert Zarnke, titled "Network Object Cache Engine", 

assigned to CacheFlow, Inc., attorney docket number CASH-001. 

and 

o PCT International Application PCT/US 98/1 1834, filed June 9, 1997, in the name 
20 of assignee CacheFlow, Inc., and inventors Michael Malcolm and Robert Zarnke, 

titled "Network Object Cache Engine", attorney docket number CASH-001 PCT. 



These applications are referred to herein as the "Cache Disclosures," and 
are hereby incorporated by reference as if fully set forth herein. 

25 

/ / / 

System Elements 



30 



Figure 1 shows a block diagram of a system having multiple caches. 

A system 100 includes a cache system 110, at least one client device 120, 
and at least one server device 130. 

4 
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Client Device 

Each client device 120 is coupled to the cache system 110 using a client 
communication path 121. The client communication path 121 can include a dial-up con- 
5 nection, a LAN (local area network), a WAN (wide area network), an ATM network, an 
IP network (such as an internet, intranet, or extranet), or some combination thereof. In a 
preferred embodiment, the client communication path 121 includes a dial-up connection, 
such as for coupling a subscriber to an ISP (internet service provider), or a LAN, such as 
for coupling a workstation to an internet connection. 

10 

As used herein, the terms "client" and "server" refer to relationships be- 
tween the client or server and the cache 1 10, not necessarily to particular physical de- 
vices. 

15 As used herein, the term "client device" includes any device taking on the 

role of a client in a client-server environment. There is no particular requirement that the 
client devices 110 must be individual devices; they can each be a single device, a set of 
cooperating devices, a portion of a device, or some combination thereof. 

20 Server Device 

Each server device 130 is also coupled to the cache system 110 using a 
server communication path 131. The server communication path 131 can include a dial- 
up connection, a LAN (local area network), a WAN (wide area network), an ATM net- 
25 work, an IP network (such as an internet, intranet, or extranet), or some combination 
thereof. In a preferred embodiment, the server communication path 131 includes an 
internet backbone and an internet connection between the cache system 110 and the 
internet backbone. 

30 As used herein, the term "server device" includes any device taking on the 

role of a server in a client-server environment. There is no particular requirement that 

5 
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the server devices *-/0 must be individual devices; they can ea^n be a single device, a set 
of cooperating devices, a portion of a device, or some combination thereof. 

The server device 130 includes memory or storage 132 for recording one or 
5 more web objects 133. The web objects 133 can include any type of data suitable for 
transmitting to the client device 1 10, such as the following: 



o text, color, formatting and directions for display; 



10 o pictures, data in graphical formats (such as GIF or JPEG), other multimedia data; 

o animation, audio (such as streaming audio), movies, and video (such as streaming 
video), and other data in audio or visual formats (such as MPEG); 

15 o program fragments, including applets, Java, JavaScript, and ActiveX; and 



o other web documents (such as when using frames); 



and 

20 o other data types (such as indicated by future extensions to HTML, DHTML, 
SGML, XML, or similar languages). 



Cache System 

25 

The cache system 110 includes a set of caches 111. Each cache 111 is 
designated a "leaf cache" if it is coupled to one or more client communication paths 121, 
and is designated a "root cache" if it is coupled to one or more server communication 
paths 131. The cache system 110 includes an inter-cache communication path 112 for 
30 communication between and among caches 111. 



6 
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The ^ter-cache communication path 112 can include a plurality of direct 
connections, a LAN (local area network), a WAN (wide area network), an IP network 
(such as an internet), or some combination thereof. In a preferred embodiment, the inter- 
cache communication path 1 12 includes a plurality of direct connections between pairs of 
5 individual caches 111. 

In a preferred embodiment the caches 111 in the cache system 1 10 are dis- 
posed in a graph structure. One or more leaf caches 1 1 1 are coupled to client communi- 
cation paths 121, and one or more root caches 1 1 1 coupled to one or more server com- 
10 munication paths 131. Where appropriate, a set of intermediate caches 1 1 1 are coupled 
to the leaf caches 1 1 1 and to the root caches 111. 

In a preferred embodiment, the graph structure is a tree structure, with a 
single root cache 1 1 1 and a plurality of leaf caches 111. For example, in a cache system 
15 110 disposed for use with an ISP (internet service provider), there is one root cache 1 1 1 
coupled to an internet backbone, and there is one leaf cache 111 for each POP (point of 
presence). In this example, the inter-cache communication path 112 includes direct con- 
nections (such as Tl or T3 connections) between the root cache 1 1 1 and each leaf cache 
111. 

20 

Cache Devices 

Each cache 111 includes a processor, program and data memory, and 
memory or storage 1 12 for recording one or more web objects 133. Each cache 1 1 1 re- 
25 tains the web objects 133 for repeated serving to client devices 120 in response to web 
requests. 

In a preferred embodiment, each cache 111 includes a router-switch 113, 

for receiving messages and distinguishing types of messages that should be processed by 

30 the cache 1 1 1 from those that should not:. For example, the router-switch 1 13 can divert 

all requests using FTP (file transfer protocol) or HTTP (hypertext transfer protocol) to 

the cache 111 for processing, while passing through other types of requests unchanged. 

7 
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In a preferred embodiment- each cache 111 incluues a cache device such as 
described in the Cache Disclosures, hereby incorporated by reference as if fully set forth 
therein, and is disposed for operating as described therein. 

5 Multiple Cache Communication 

Each leaf cache 111 receives requests from client devices 120 for web ob- 
jects 133. The web objects 133 might be cacheable or non-cacheable. 

10 If a client device 120 requests a cacheable web object 133, the leaf cache 

111 might already have the requested web object 133 in its memory or storage 112. If 
so, the leaf cache 111 serves the requested web object 133 to the client device 120 with- 
out having to request the web object 133 from the root cache 1 1 1 or from the server de- 
vice 130. If the leaf cache 1 1 1 does not already have the requested web object 133, the 

1 5 leaf cache 111 requests it from the root cache 111. 

The root cache 1 1 1 performs a similar caching function, returning the re- 
quested cacheable web object 133 directly to the leaf cache 111 if it is already present in 
its own memory or storage 112, without having to request that web object 133 from the 
20 server device 130. If the root cache 1 1 1 does not already have the requested web object 
133 in its memory or storage 1 12, the root cache 1 1 1 requests it from the server device 
120. 

If the leaf cache 1 1 1 and the root cache 1 1 1 do not already have a copy of 
25 the web object 133 in their respective memory or storage 112, the root cache 111 re- 
quests the web object 133 from the server device 120. Similarly, if the web object 133 is 
considered not cacheable, the root cache 1 1 1 requests the web object 133 from the server 
device 120 whether or not it has already that web object 133 in their respective memory 
or storage 112. The server device 120 receives the request and returns the requested web 
30 object 1 33 to the root cache 111. 

8 
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Objects Already in storage 

The root cache 1 1 1 receives the requested web object 133 from the server 
device 110, records it in its memory or storage 112, and determines an object signature 
5 134 for the web object 133. In a preferred embodiment, the root cache 1 1 1 computes the 
object signature 134 itself. In alternative embodiments, the server device 120 may com- 
pute and record the object signature 134 and transmit it to the root cache 1 1 1 with the 
web object 133. 

10 In a preferred embodiment, the object signature 134 includes an MD5 di- 

gest of the web object 133. In alternative embodiments, the object signature 134 may 
comprise a CRC, MD4, SHA, or other known function of the web object 133. 

There is no particular need for any device to be able to recover the web 
15 object 133 a priori from the object signature 134. It is sufficient that the root cache 1 1 1 
or the leaf cache 111 can determine, in response to the object signature 134, if the web 
object 133 is present in its memory or storage 1 12, and if so, which web object 133 cor- 
responds to that object signature 134. 

20 If the web object 133 is cacheable but was requested from the server device 

1 10, the request from the server device 120 was due to a cache miss. However, it can 
still occur that the leaf cache 1 1 1 (or some intermediate cache 111) already has the web 
objects 133 in its memory or storage 1 12, such as recorded in association with a different 
URL (uniform resource locator) or other identifier. In a preferred embodiment, each 

25 cache 111 records web objects 133 in association with the URL used to request those 
web objects 133. 

For a first example, multiple server devices 120 can record mirror copies of 
identical web objects 133. For a second example, non-identical web objects 133 can in- 
30 elude identical embedded web objects 133 (such as common graphics, animation, or pro- 
gram fragments). 
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If the *veb object 133 is considered non-cachea^ie, it was requested from 
the server device 120 because non-cacheable web objects 133 are not meant to be served 
from the cache 111. However, it can still occur that the leaf cache 111 (or some interme- 
diate cache 111) already has the web objects 133 in its memory or storage 112, because 
5 the non-cacheable web object 133 had been requested earlier. 

For a first example, if the web object 133 is responsive to a CGI script or 
database search, it can be identical to the results of an earlier response to that CGI script 
or database search. For a second example, if the web object 133 is determined dynami- 
10 cally by the server device 130 (such as randomly selected advertisements), it can be 
identical to an earlier advertisement transmitted by the server device 130. 

The root cache 1 1 1 transmits the object signature 134 to the leaf cache 111. 
The leaf cache 1 1 1 determines, in response to the object signature 134, whether it already 

15 has the associated web object 133 in its memory or storage 112 and if so, which one is 
the associated web object 133. If so, the leaf cache 1 1 1 serves the associated web object 
133 to the client device 120 from its memory or storage 1 12 without the root cache 1 1 1 
having to actually transmit the entire web object 133. If not, the root cache 111 transmits 
the actual web object 133 to the leaf cache 111, which can then serve it to the client de- 

20 vice 120. 

In a preferred embodiment, the root cache 111 includes a bitmap 1 14 in its 
memory or storage 1 12 for each non-cacheable web object 133, including one bit 115 for 
each leaf cache 111. Each bit 1 15 of the bitmap 1 14 indicates whether its associated leaf 
25 cache 111 has a copy of the web object 133. 

The root cache 111 directly transmits the actual web object 133 to the leaf 

cache 111 if the associated bit 115 of the bitmap 114 indicates that the leaf cache 111 

does not have the web object 133. If the bit 115 indicates that the leaf cache 111 does 

30 have the web object 133, the root cache 1 1 1 attempts to transmit only the object signature 

134. However, even if the bit 115 indicates that the leaf cache 111 does have the web 

object 133, it may occur that the leaf cache 111, being a cache, has discarded the web 

10 
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object 133 in the in-rim. In this case, the leaf cache 1 1 1 so indicates and re-requests the 
web object 133 from the root cache 111. 

In a preferred embodiment, when the root cache 1 1 1 transmits the object 
5 signature 134 to the leaf cache 111, it so indicates using a data type, such as a MIME 
type, or a new type of object, indicating that the transmission includes only the object 
signature 134. 

Compression for Transmission 

10 

When transmitting actual web objects 133 between caches 111 (such as 
from the root cache 111 to the leaf cache 111), those web objects 133 are substantially 
compressed for transmission and decompressed after reception. Compression for trans- 
mission can be applied both to cacheable and to non-cacheable web objects 133. 

15 

Compression for transmission can include various techniques, such as 
Huffman coding, Liv-Zempel compression, or other known lossless compression. Com- 
pression for transmission can also include known lossy compression, such as JPEG, 
MPEG, or other audio and video codec techniques, when appropriate for the type of web 
20 object 133. 

Those skilled in the art will recognize, after perusal of this application, that 
transmission of the object signature 134 in place of the actual web object 133 is a form of 
substantial compression. This form of compression is unreliable, in the computer science 
25 sense that the receiver is not guaranteed to be able to recover the web object 133 from its 
object signature 134. In fact, using this form of compression the leaf cache 1 1 1 can only 
do so if the web object 133 is already recorded in its memory or storage 1 12. 

Unreliable Dictionary Compression 

30 

As used herein, "dictionary compression" means a form of communication 

in which a sender and a destination each maintain a set of dictionary elements and a set 

11 
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of associated tag v._jes, each tag value being representative o. one of the dictionary ele- 
ments. There is no particular requirement that the dictionary elements can be recovered 
from their associated tag values without further information. Rather, dictionary com- 
pression refers generally to a system in which the dictionary elements can be associated 
5 with arbitrary tag values. 

The sender and the destination each associate the same tag value with the 
same dictionary element. For example, the sender can transmit the dictionary element, 
along with an arbitrarily selected tag value, to the destination to make the association. 
10 Systems in which the sender does this, and the destination maintains a dictionary of such 
tag values in response thereto, are known in the art. 

As used herein, "unreliable" dictionary compression means that the desti- 
nation might possibly discard the association between the tag value and the dictionary 
15 element. 

In a preferred embodiment, each dictionary element includes a complete 
web object 133, and the tag value associated with each particular web object 133 is a 
known function of that particular web object 133. The known function is preferably an 
20 MD5 signature, as noted herein. 

In a preferred embodiment, the destination (because it is a cache) can dis- 
card any particular web object 133, and thus lose the association between that particular 
web object 133 and its MD5 signature. That is, the destination (because it has discarded 
25 the particular web object 133) can no longer determine if a particular MD5 signature is 
associated with any known web object 133. Moreover, the destination cannot determine 
the web object 133 in response to the MD5 signature without further information. 

Transmission of the object signature 134 in place of the actual web object 
30 133 is a form of dictionary compression in which the entire actual web object 133 is the 
dictionary element. If the leaf cache 1 1 1 has discarded that dictionary element, it re- 
quests the root cache 1 11 to retransmit the actual web object 133 using a second form of 

12 
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compression. Foi example, the second form of compression can include a known 
lossless compression technique such as Liv-Zempel compression or the form of compres- 
sion used in the PKZIP product available from PKWare, Inc. 

5 Those skilled in the art will recognize, after perusal of this application, that 

unreliable dictionary compression is applicable in various other applications that can use 
compression. In a preferred embodiment, unreliable compression is acceptable because 
the root cache 1 1 1 can retransmit the web object 133 using a more reliable (but possibly 
less strong) compression technique. 

10 

Other Web Object Information 

The root caches 1 1 1 and the leaf caches 111 can also exchange other in- 
formation about the web objects 133. 

15 

In a preferred embodiment, the cache system 110 collectively maintains 
information for each web object 133 regarding the following: 

o A probability the web object 133 in the cache system 110 will be next requested 
20 by some client device 120. This information will likely be best available at the 

leaf caches 111. 

and 

o A probability the web object 133 in the cache system 1 10 will be stale. This in- 
25 formation will likely be best available at the root caches 111. 

The cache system 110 can collectively determine from this information 
whether the web object 133 is the next web object 133 recorded by the cache system 1 10 
to be served state. As described in the Cache Disclosures, particularly attorney docket 
30 numbers CASH-003 and CASH-004, this information can be used to determine which 
web objects 133 to actively refresh. 

13 
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Acthw refresh can also be applied to frequently -requested non-cacheable 
web objects 133, and distributed within the cache system 110, even though those web 
objects 133 are re-requested from the server devices 120 each time. Active refresh is 
well suited to web objects 133 such as advertisements, news reports, stock quotes, 
weather reports, and the like. 

The cache system 1 10 can also maintain information about each web object 
133 regarding at which cache 111 in the cache system 110 that web object 133 is re- 
corded. With this information, the root cache 111 can request cached web objects 133 
from one of the leaf caches 1 1 1, in addition to or instead of re-requesting the web objects 
133 from server devices 120. 

Method of Operation 

Figure 2 shows a process flow diagram for a method of using a system 
having multiple caches. 

A method 200 is performed by the system 100, including the cache system 
1 10, the client devices 120, and the server devices 130. 

At a flow point 210, one of the client devices 120 is ready to request a web 

object 133. 

At a step 21 1, one of the client devices 120 sends a message to its associ- 
25 ated leaf cache 1 1 1 requesting a selected web object 133. The request message prefera- 
bly uses the FTP or HTTP protocol, and includes a URL for the selected web object 133. 

At a step 212, the leaf cache 1 1 1 determines if the web object 133 is cache- 
able or non-cacheable. If the web object 133 is cacheable, the method 200 proceeds with 
30 the next step. If the web object 133 is non-cacheable, the method 200 proceeds with the 
flow point 220. 



20 
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At a ^ep 213, the leaf cache 1 1 1 determines if ine web object 133 is pres- 
ent in its memory or storage 112. In a preferred embodiment, the leaf cache 1 1 1 makes 
this determination in response to the URL for the selected web object 133 included in the 
request from the client device 120. If the web object 133 is present, the method 200 pro- 
5 ceeds with the next step. If the web object 133 is not present, the method 200 proceeds 
with the flow point 220. 

At a step 2 14, the leaf cache 1 1 1 serves the web object 133 to the client de- 
vice 120. The method 200 continues with the flow point 210. 

10 

At a flow point 220, the leaf cache 1 1 1 is unable to serve the web object 
133 from its memory or storage 1 12, either because there has been a leaf cache miss or 
because the web object 133 is non-cacheable. 

1 5 At a step 22 1 , similar to the step 2 1 1 , the leaf cache 1 1 1 sends a message to 

the root cache 1 1 1 requesting the web object 133. 

At a step 222, similar to the step 212, the root cache 1 1 1 determines if the 
web object 133 is cacheable or non-cacheable. If the web object 133 is cacheable, the 
20 method 200 proceeds with the next step. If the web object 133 is non-cacheable, the 
method 200 proceeds with the flow point 230. 

At a step 223, similar to the step 213, the root cache 1 1 1 determines if the 
web object 133 is present in its memory or storage 1 12. In a preferred embodiment, the 
25 root cache 1 1 1 makes this determination in response to the URL for the selected web 
object 133 included in the request from the client device 120. If the web object 133 is 
present, the method 200 proceeds with the next step. If the web object 133 is not present, 
the method 200 proceeds with the flow point 230. 

30 At a step 224, similar to the step 214, the root cache 1 1 1 transmits the web 

object 133 to the leaf cache 111. The method 200 continues with the flow point 210. 

15 
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At a ..jw point 230, the root cache 1 1 1 is unable *o transmit the web object 
133 from its memory or storage 1 12, either because there has been a root cache miss or 
because the web object 133 is non-cacheable. 

5 At a step 231, similar to the step 21 1, the root cache 1 1 1 sends a message 

to the indicated server device 130 requesting the web object 133. The request message 
preferably uses the FTP or HTTP protocol, and includes a URL for the selected web ob- 
ject 133. 

10 At a step 232, the server device 130 transmits the web object 133 to the 

root cache 111. 

At a step 233, the root cache 1 1 1 determines an object signature 134 for the 
web object 133. 

15 

At a step 234, the root cache 1 1 1 determines if the web object 133 is pres- 
ent in its memory or storage 112. In a preferred embodiment, the root cache 1 1 1 makes 
this determination in response to the object signature 134. If the web object 133 is pres- 
ent, the method 200 proceeds with the next step. If the web object 133 is not present, the 
20 method 200 proceeds with the flow point 240. 

At a step 235, the root cache 1 1 1 determines if the web object 133 is likely 
present at the requesting leaf cache 111. In a preferred embodiment, the root cache 111 
makes this determination in response to the bitmap 114 for the web object 133. If the 
25 web object 133 is likely present at the leaf cache 1 1 1, the method 200 proceeds with the 
next step. If the web object 133 is likely not present at the leaf cache 111, the method 
proceeds with the flow point 240. 

At a step 236, the root cache 111 transmits the object signature 134 to the 
30 leaf cache 111. 

16 
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At a _<;p 237, the leaf cache 1 1 1 determines if u*e web object 133 is pres- 
ent in its memory or storage 1 12, in response to the object signature 134. If the web ob- 
ject 133 is not present, the method 200 proceeds with the next step. If the web object 133 
is present, the method 200 proceeds with the flow point 240. 

5 

At a step 238, the leaf cache 1 1 1 transmits a message to the root cache 1 1 1 
indicating that the web object 133 is not present. 

At a step 239, the root cache 1 1 1 transmits the actual web object 133 to the 
10 leaf cache 111. As noted above, the actual web object 133 is compressed for transmis- 
sion and decompressed upon reception. 



At a flow point 240, the leaf cache 1 1 1 is ready to serve the web object 133 
to the requesting client device 120. The method proceeds with the step 214. 

15 

Alternative Embodiments 

Although preferred embodiments are disclosed herein, many variations are 
possible which remain within the concept, scope, and spirit of the invention, and these 
20 variations would become clear to those skilled in the art after perusal of this application. 
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Claims 



1 . A method including steps for 

compressing, at a first cache, an object stored at said first cache; 
5 coupling a compressed version of said object from said first cache to a sec- 

ond cache. 

decompressing, at said second cache, an uncompressed version of said ob- 
ject. 

1Q 2. A method as in claim 1, wherein said second cache can only recover 

an uncompressed object from said compressed object in response to a contents of said 
second memory. 

3. A method as in claim 1, wherein said second cache can recover an 
1 5 uncompressed object from said compressed object without further information. 

4. A method as in claim I, wherein 

said steps for compressing include steps for determining a known function 
of a first object at said first cache; 
20 said compressed version includes a result of said known function; 

said steps for decompressing include steps for determining said known 
function of a second object at said second cache, and comparing said compressed version 
with a result of said known function of said second object. 

25 5. A method as in claim 4, wherein said known function is substan- 

tially irreversible. 

6. A method including steps for 

determining, at a first cache, a first object signature responsive to said first 

30 object; 

coupling said first object signature to a second cache; 
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comparing, at said second cache, said first object signature with a function 
of at least one second object; 

refraining from transmitting said first object in response to said steps for 

comparing. 

5 

7. A method as in claim 6, including steps for 

coupling a result of said steps for comparing to said first cache; and 
coupling said first object to said second cache responsive to said compari- 
son result. 

10 

8. A method as in claim 6, 

including steps for storing at said first cache information whether said first 
object is likely to be stored at said second cache; 

wherein said steps for transmitting said object signature are responsive to 
1 5 said information. 



9. A method including steps for 

determining, at a first cache, first information regarding a likelihood 
whether an object received from a server is stale; 
20 determining, at a second cache, second information regarding a likelihood 

whether said object will be requested by a client; 

coupling said first information and said second information between said 
first memory and said second memory; 

discarding said object at first cache disposed in response to said second in- 
25 formation; and 

discarding said object at said second cache disposed in response to said 
first information. 



10. A method including steps for 
30 storing a first object at a first cache; 

determining an object signature at said first cache in response to said ob- 
ject; 

19 



BNSDOCID: <WO 00071 24A2J_> 



WO 00/07124 



PCT/US99/I7149 



transmitting said object signature to a second cauie; 

comparing said object signature with a function of at least one object stored 
at said second cache; 

transmitting said first object to said second cache in response to said steps 
5 for comparing. 

11. A method as in claim 10, 

including steps for storing at said first cache information whether said first 
object is likely to be stored at said second cache; 
10 wherein said steps for transmitting said object signature are responsive to 

said information. 



12. A method as in claim 10, including steps for transmitting a result of 
said steps for comparing to said first cache. 

15 

13. A method including steps for 

storing, at a first cache, a first object and first information regarding 
whether to discard said first object; 

storing, at a second cache, a second object and second information regard- 
20 ing whether to discard said second object; 

coupling said first information to said second cache; and 

discarding said second object in response to said first information and in 
response to said second information. 



25 14. A method as in claim 13, including steps for 

coupling said second information to said first cache; and 
discarding said first object in response to said first information and in re- 
sponse to said second information. 

30 15. A method as in claim 13, wherein said first information includes a 

likelihood of said object being stored at said second cache. 

20 
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16. A method including steps for 

storing, at a first cache, an object from a server and first information re- 
garding said object at said server; 

storing, at a second cache, an object for delivery to a client and second in- 
5 formation regarding requests for said object by said client; 

transmitting said first information from said first cache to said second 

cache; 

transmitting said second information from said second cache to said first 

cache; 

10 whereby said first cache and said second cache can collectively operate 

more effectively. 



17. A system including 

a first cache disposed for being coupled to a server, and having memory for 
15 storing an object from said server and for storing first information regarding said object 
at said server; 

a second cache disposed for being coupled to a client, and having memory 
for storing said object for delivery to said client and for storing second information re- 
garding requests for said object by said client; 
20 a first communication path between said first cache and said second cache, 

disposed for transmitting said first information from said first cache to said second cache; 

a second communication path between said first cache and said second 
cache, disposed for transmitting said second information from said second cache to said 
first cache; 

25 whereby said first cache and said second cache can collectively operate 

more effectively. 



18. A system including 

a first cache disposed for being coupled to a server, and having memory for 

30 storing an object from said server, said object having an associated object signature; 

a second cache disposed for being coupled to a client, and having memory 

for storing said object for delivery to said client; 
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a coix.xnunication path between said first cachw and said second cache, 
whereby said first cache can transmit either said object signature or said object to said 
second cache; 

whereby said first cache can refrain from transmitting said object to said 
5 second cache when said object is already stored at said second cache. 

19. A system as in claim 18, including a communication path between 
said second cache and said first cache, whereby said second cache can transmit a result of 
a comparison between said object signature and said object at said second cache. 

10 

20. A system as in claim 18, including a communication path 
coupling said object signature to said second cache; 

coupling a result of a comparison between said object signature and a 
function of said object at said second cache; and 
15 coupling said object to said second cache responsive to said comparison 

result. 

21. A system as in claim 18, including 

a first communication path coupling said object signature to said second 

20 cache; 

a second communication path coupling to said first cache a result of a 
comparison between said object signature and a function of said object at said second 
cache; and 

a third communication path coupling said object to said second cache re- 
25 sponsive to said comparison result. 

22. A system as in claim 18, including 

a third cache disposed for being coupled to a second client, and having 
memory for storing said object for delivery to said second client; 
30 a communication path between said first cache and said third cache, 

whereby said first cache can transmit either said object signature or said object to said 
third cache; 
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wher said first cache can refrain from transmitting said object to said 
third cache when said object is already stored at said third cache. 

23. A system as in claim 18, including memory at said first cache in- 
5 eluding information whether said object is likely to be stored at said second cache. 

24. A system including 

a first cache including a first memory and an information compressor; 

a second cache including a second memory and an information decompres- 

10 sor; and 

a communication path disposed for coupling a compressed object from said 
first cache to said second cache. 

25. A system as in claim 24, wherein 
1 5 said first memory includes a first object; 

said information compressor includes a known function; 

said communication path is disposed for coupling to said second cache a 
first result of said known function applied to said first object; 

said second memory includes a second object; 
20 said information decompressor includes said known function, and a com- 

parison between said first result and a second result of said known function applied to 
said second object; 

whereby said second cache is disposed for determining that said second 
object is substantially identical to said first object in response to a result of said compari- 
25 son. 

26. A system as in claim 25, wherein said known function is substan- 
tially irreversible. 

27. A system as in claim 24, wherein said information compressor is 

23 
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28. A system as in claim 24, wherein said second cache can only re- 
cover an uncompressed object from said compressed object in response to a contents of 

said second memory. 

29. A system as in claim 24, wherein said second cache can recover an 
uncompressed object from said compressed object without further information. 

30. A system including 

a first cache including a first object and a first object signature responsive 
to said first object; 

a second cache including a second object, said second cache coupled to 
said first object signature; 

said first cache coupled to a result of a comparison between said first object 
signature and a second object signature responsive to said second object; 

whereby said first cache can refrain from transmitting said first object in 
response to said comparison. 

31. A system as in claim 30, including a communication path 
coupling said first object signature to said second cache; 
coupling said comparison result to said first cache; and 

coupling said first object to said second cache responsive to said compari- 



son result. 



ond cache; 
cache; and 



32. A system as in claim 30, including 

a first communication path coupling said first object signature to said sec- 
a second communication path coupling said comparison result to said first 



a third communication path coupling said first object to said second cache 
responsive to said comparison result. 



33. A system as in claim 30, including 
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a thh_ cache including a third object, said third wache coupled to said first 
object signature; 

said first cache coupled to a result of a second comparison between said 
first object signature and a third object signature responsive to said third object; 
5 whereby said first cache can refrain from transmitting said first object in 

response to said second comparison. 

34. A system as in claim 30, including information at said first cache 
whether said transmitting said first object is likely to be desirable. 

10 

35. A system including 

a first cache including a first object and first information regarding whether 
to discard said first object; 

a second cache coupled to said first information, said second cache includ- 
15 ing a second object and second information regarding whether to discard said second 
object, said second cache disposed for discarding said second object in response to said 
first information and in response to said second information. 

36. A system as in claim 35, wherein 

20 said first cache is coupled to said second information and is disposed for 

discarding said first object in response to said first information and in response to said 
second information. 

37. A system as in claim 35, wherein said first information includes a 
25 likelihood of said object being stored at said second cache. 

38. A system including 

a first cache including first information regarding a likelihood whether an 
object received from a server is stale; 
30 a second cache including second information regarding a likelihood 

whether said object will be requested by a client; 
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a cou^nunication path capable of coupling saia rirst information and said 
second information between said first memory and said second memory; 

said first cache disposed for discarding said object in response to said sec- 
ond information; and 

5 said second cache disposed for discarding said object in response to said 

first information. 

39. A system including 

a first memory including a first object received from a server and a first 
10 object signature responsive to said first object; 

a second memory including a second object ready for delivery to a client; 
a communication path capable of coupling said first object signature to said 
second memory; 

a comparator coupled to said second memory and to said communication 
15 path, responsive to whether a second object signature responsive to said second object is 
substantially identical to said first object signature; 

said communication path capable of coupling an output of said comparator 
to said first memory; 

whereby said first memory can refrain from delivering said first object to 
20 said second memory in response to said output of said comparator. 

40. A system including 

a plurality of caches, each including memory; 

a communication network coupling each said cache to substantially all 
25 other said caches; 

at least a first said cache having an object in its memory and disposed to 
transmit said object to a second said cache only if said second cache does not already 
have said object in its memory. 

30 41. A system as in claim 40, including memory at said first cache in- 

cluding information whether said object is likely to be stored at said second cache. 
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42. A system as in claim 40, wherein said communication network 
couples an object signature for said object to said second cache; 

couples to said first cache a result of a comparison between said object sig- 
nature and a function of said object at said second cache; and 
5 couples said object to said second cache responsive to said comparison re- 

sult. 

43. A system as in claim 40, wherein 

said first cache includes a first signature function coupled to memory for 
10 said first cache; 

said second cache includes a second signature function coupled to memory 
for said second cache, and a comparator coupled to said first signature function and said 
second signature function; 

wherein said first cache refrains from transmitting said first object in re- 
15 sponse to said comparator. 

44. A system including 

a set of root caches disposed for receiving a data item from a set of servers; 

a set of leaf caches disposed for delivering said data item to a set of clients, 
20 at least one of said leaf caches being coupled to at least one of said root caches; 

wherein said root caches and said leaf caches include memory having said 
data item stored therein after an initial use of said data item; 

wherein said data item has an associated item signature, said item signature 
being responsive to said data item; 
25 wherein if a server returns a second data item substantially identical to said 

one data item, said one root cache transmits said item signature to said one leaf cache; 

whereby said one root cache refrains from transmitting said data item more 
than once to said one leaf cache. 

30 45. A system as in claim 44, wherein said set of root caches and said set 

of leaf caches are disposed in a tree structure. 
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46. A system as in claim 44, wherein said sei of root caches has exactly 

one member. 

47. A system as in claim 44, including memory in said one root cache 
5 indicating for each particular said leaf cache whether said particular leaf cache is likely to 

have said data item in its memory. 

48. A method including steps for 

associating, at both a source and a destination, a tag value with a dictionary 

10 element; 

if said dictionary element is present at said destination, transmitting, from 
said source to said destination, said tag value in place of said dictionary element; 

if said dictionary element is not present at said destination, transmitting, 
from said source to said destination, said dictionary element. 

15 

49. A method including steps for 

providing a set of associations, at both a source and a destination, each as- 
sociation including a tag value and a dictionary element; 

possibly discarding one or more of said set of associations at said destina- 

20 tion; 

transmitting, from said source to said destination, a selected tag value or its 
associated dictionary element, in response to said steps for possibly discarding. 

50. A method as in claim 49, including steps for 

25 transmitting, from said destination to said source, an indication responsive 

to said steps for possibly discarding; 

whereby if said dictionary element is still present at said destination, said 
source does not need to transmit said dictionary element to said destination. 

30 5 1 . A method including steps for 

transmitting a dictionary element from a source to a destination; 
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assorting, at both said source and said destination, a tag value with said 
dictionary element; 

possibly discarding said dictionary element at said destination; 
transmitting, from said source to said destination, said tag value or said 
dictionary element in response to said steps for possibly discarding. 

52. A method as in claim 51, including steps for 

transmitting, from said destination to said source, an indication responsive 
to said steps for possibly discarding; 

whereby if said dictionary element is still present at said destination, said 
source does not need to transmit said dictionary element to said destination. 

53. Unreliable dictionary compression. 

54. A method as in claim 53, wherein a set of dictionary elements for 
said method each includes an entire object deliverable from a server to a client. 

55. A method as in claim 53, wherein a set of dictionary elements for 
said method includes at least one object larger than one kilobyte. 

56. A system including 

means for associating, at both a source and a destination, a tag value with a 
dictionary element; 

means, if said dictionary element is present at said destination, for trans- 
mitting, from said source to said destination, said tag value in place of said dictionary 
element; 

means, if said dictionary element is not present at said destination, for 
transmitting, from said source to said destination, said dictionary element. 

57. A system including 

means for providing a set of associations, at both a source and a destina- 
tion, each association including a tag value and a dictionary element; 
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mear^ for possibly discarding one or more of ^aid set of associations at 
said destination; 

means for transmitting, from said source to said destination, a selected tag 
value or its associated dictionary element, in response to said steps for possibly discard- 
5 ing. 

58. A system as in claim 57, including 

means for transmitting, from said destination to said source, an indication 
responsive to said steps for possibly discarding; 
10 whereby if said dictionary element is still present at said destination, said 

source does not need to transmit said dictionary element to said destination. 

59. A system including 

means for transmitting a dictionary element from a source to a destination; 
1 5 means for associating, at both said source and said destination, a tag value 

with said dictionary element; 

means for possibly discarding said dictionary element at said destination; 

means for transmitting, from said source to said destination, said tag value 
or said dictionary element in response to said steps for possibly discarding. 

20 

60. A system as in claim 59, including 

means for transmitting, from said destination to said source, an indication 
responsive to said steps for possibly discarding; 

whereby if said dictionary element is still present at said destination, said 
25 source does not need to transmit said dictionary element to said destination. 
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